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(57) ABSTRACT 

A method and system for generating an HTML (hypertext 
markup language) file including images captured by a digital 
imaging device, the digital imaging device having a display. 
A script and it's predefined model are provided to the digital 
camera. The script is comprised of a set of software program 
instructions. The digital camera executes the script to dis- 
play interactive instructions on the display that prompt a 
user to perform specific operations. In response to the user 
performing the specific operations, the digital camera auto- 
matically updates the interactive instructions, such that the 
user is guided through a series of related image captures to 
obtain a series of resulting images. The digital camera then 
generates an HTML file including the resulting images, 
wherein the HTML file is formatted in accordance with the 
predefined model. 

19 Claims, 11 Drawing Sheets 
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METHOD AND SYSTEM FOR PRODUCING 
AN INTERNET PAGE DESCRIPTION FILE 
ON A DIGITAL IMAGING DEVICE 

FIELD OF THE INVENTION 

The field of the present invention pertains to digital image 
capture devices. More particularly, the present invention 
relates to a method and system for producing HTML using 
the electronic systems within a digital camera. 

BACKGROUND OF THE INVENTION 

Most digital cameras today are very similar in size and 
behavior to conventional point-and-shoot cameras. Modern 
digital cameras for taking pictures of scenes and the like 
typically include an imaging device which is controlled by 
a computer running a software program. When an image is 
captured, the imaging device is exposed to light and gener- 
ates raw image data representing the image. The raw image 
data is typically stored in a single image buffer where it is 
then processed and compressed by the processor. Many 
types of compression schemes are used to compress the 
image data, with the joint photographic expert group (JPEG) 
standard being the most popular. After the processor pro- 
cesses and compresses the raw image data into JPEG image 
files, the processor stores the JPEG image files into an 
internal memory or on an external memory card. 

Some digital cameras are also equipped with a liquid- 
crystal display (LCD) or other type of display screen on the 
back of the camera. Through the use of the LCD, the 
processor can cause the digital camera to operate in one of 
two modes, play and record, although some cameras only 
have a record mode. In play mode, the LCD is used as a 
playback screen for allowing the user to review previously 
captured images either individually or in arrays of four, nine, 
or sixteen images. In record mode, the LCD is used as a 
viewfinder in which the user may view an object or scene 
before taking a picture. 

Besides the LCD, digital camera user interfaces also 
include a number of buttons or switches for setting the 
camera into one of the two modes and for navigating 
between pictures in play mode. For example, most digital 
cameras include two buttons labeled "-" and "+" that enable 
a user to navigate or scroll through captured pictures. For 
example, if the user is reviewing pictures individually, 
meaning that single pictures are displayed full-sized in the 
LCD, pressing one of navigation buttons causes the cur- 
rently displayed picture to be replaced by the next picture. 

The electronic nature of the digital camera's pictures 
make them particularly well suited for use with other 
electronic applications. The pictures are also particularly 
well suited for use in the creation of complex text and image 
documents. Using document creation software applications, 
the pictures can be incorporated into a document along with 
corresponding text annotations or descriptions. Once 
created, the documents can be electronically transmitted 
(e.g., via email) or printed and distributed conventionally. 
The resulting document can be formatted in accordance with 
any of a number of popular page description languages used 
for the Internet, such as HTML (hypertext markup 
language), XML (extensible markup language), java script, 
and the like. 

For example, once the HTML file, referencing the pictures 
has been created, it can easily be exchanged among any 
number of users via email and subsequently viewed (e.g., as 
a web page) using any of a number of web browsers. 
Alternatively, the HTML file itself can be made available 
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over the Internet using web server software. The HTML file 
essentially becomes a web page which web browser 
equipped users can view or download on demand. 

However, even with these advanced capabilities, it 

5 remains desirable to make the user's experience with the 
digital camera as intuitive and "hassle-free" as possible. The 
objective is to provide the advanced capabilities afforded by 
a digital camera while retaining the simplicity and straight 
forwardness of conventional point and shoot cameras. 

10 Consequently, there is a problem in providing sophisti- 
cated capabilities and features to the user while still retain- 
ing a simple straight forward method of operation. For 
example, to create and electronically distribute a document 
and pictures from a digital camera, a user needs to first 
capture the image (e.g., take the picture), and then transfer 
the image to a personal computer. One method involves 
transferring a removable storage element (e.g., a flash disk) 
from the digital camera to a corresponding input peripheral 
device (flash disk attachment) coupled to the personal com- 
puter. Another method involves tethering the camera to the 

20 computer and transferring the file to the computer using a 
specialized software application. The user can then manipu- 
late the image using a separate image editing software tool, 
or use any image editing features included in the specialized 
software application. The user then imports the image into a 

25 document editing application. If the resulting document is to 
be in HTML format, an HTML publishing application would 
typically be used. There, the user formats the document by, 
for example, annotating the image with, for example, 
descriptive text, and including any other patentee infonna- 

30 tion. The image is placed on the "page" with respect to the 
descriptive text (e.g., title, subheadings, etc.). The resulting 
document is saved in HTML format. 

Thus, in order to create an HTML file including images 
taken with the digital camera, in addition to taking the 

35 picture, the user is currently required to know how to 
transfer the picture to the PC, import the image into an image 
editing application, import the image into an HTML pub- 
lishing application, and format an HTML file. As the infor- 
mation must be entered while using the HTML publishing 

4 o application, as opposed to when the pictures are taken, the 
user needs to remember the relevant details about each 
picture or have previously taken notes regarding the pictures 
elsewhere. In addition to all of the above, the user is also 
required to have the requisite skills in operating the image 

4 5 editing application, and operating the HTML publishing 
application. 

Hence, what is needed is an inexpensive method and 
system for capturing images and generating a formatted 
electronic document which references those images. The 

50 document should be readily interchangeable among users 
using a variety of computer implemented methods, such as, 
for example, email, LANsAVANs (local area networks/wide 
area networks), or the Internet. The process of creating the 
formatted document including the image should be intuitive 

55 and user friendly. The present invention provides a novel 
solution to the above requirements. 

SUMMARY OF THE INVENTION 
The present invention provides an inexpensive method 

60 and system for capturing images and generating a formatted 
electronic document which includes those images. The 
document is readily interchangeable among users using a 
variety of computer implemented methods, such as, for 
example, email, LAN/WANs, or the Internet. The present 

65 invention provides a process of creating the formatted 
document including the image which is intuitive and user 
friendly. 
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In one embodiment, the present invention comprises a 
method and system for generating a page description file, 
such as HTML (hypertext markup language) that references 
images captured by a digital camera. A script, comprised of 
computer readable instructions, is provided to the digital 5 
camera. The script is interpreted by the camera such that the 
camera sequences though a series of actions, such as for 
example, prompting the user to take a picture, prompting the 
user to enter any descriptive information regarding a picture, 
and the like. The script also includes a set of predefined 
instructions and formatting commands which are adapted to 
create a formatted web page (e.g., HTML file) in accordance 
with a certain desired appearance. This set of instructions 
and commands are referred to as a "model". The creator of 
the script develops the model in accordance with the par- 
ticular requirements to which the script is designed. 15 

The digital camera executes the script to display interac- 
tive instructions on the camera's display that prompt a user 
to perform specific operations. In response to the user 
performing the specific operations, the digital camera auto- 
matically updates the interactive instructions, such that the 20 
user is guided through a series of steps, such as, for example, 
taking a series of related image captures and annotating 
them. The digital camera then generates an HTML file 
referencing the resulting images, wherein the HTML file is 
formatted in accordance with the script's predefined model. 25 

In so doing, the present invention allows a user having no 
knowledge of HTML to produce HTML and image files 
which describe one or more web pages including the result- 
ing images. The web pages are viewable through the use of 
any of a number of widely used web browsers. In addition, 30 
the present invention allows the user to annotate and enter 
descriptive information regarding the images at the time 
they are captured, rather than having to first transfer the 
captured images to a PC or enter notes elsewhere. 

The HTML file can then be downloaded from the digital 35 
camera using, for example, a removable storage device 
(flash disk, PC Card, etc.). Alternatively, in another 
embodiment, the HTML file can be made directly available 
over the Internet through the use of a web server hosted by 
the digital camera itself. 40 

BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention is illustrated by way of example 
and not by way of limitation, in the figures of the accom- 
panying drawings in which like reference numerals refer to 45 
similar elements and in which: 

FIG. 1 shows a block diagram of a digital camera for use 
in accordance with the present invention. 

FIG. 2 shows a block diagram of an imaging device in 
accordance with one preferred embodiment of the present 50 
invention. 

FIG. 3 shows a block diagram of a computer in accor- 
dance with one preferred embodiment of the present inven- 
tion. 

FIG. 4 shows a memory map of a DRAM in accordance 
with one embodiment of the present invention. 

FIG. 5A shows a top view diagram depicting the preferred 
hardware components of the camera from FIG. 1. 

FIG. 5B shows a back view diagram depicting the pre- 60 
ferred hardware components of the camera from FIG. 1. 

FIG. 6A shows a diagram of a first directed image capture 
screen in accordance with one embodiment of the present 
invention. 

FIG. 6B shows a diagram of a second directed image 65 
capture screen in accordance with one embodiment of the 
present invention. 
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FIG. 7 shows a block diagram illustrating the contents of 
a ROM and DRAM of a the camera from FIG. 1. 

FIG. 8 is a flow chart illustrating an exemplary process of 
installing and running a script in accordance with one 
embodiment of the present invention. 

FIG. 9 shows a web page as described by an HTML file 
created by a script in accordance with one embodiment of 
the present invention. 

FIG. 10 shows a diagram of a digital camera of the present 
invention coupled to the Internet via an ISP and a dial-up 
connection. 

FIG. 11 shows a diagram of the connectivity and appli- 
cation software of the camera from FIG. 10 is shown. 

DETAILED DESCRIPTION OF THE 
INVENTION 

In the following detailed description of the present 
invention, numerous specific details are set forth in order to 
enable one of ordinary skill in the art to make and use the 
invention and is provided in the context of a patent appli- 
cation and its requirements. Although the present invention 
will be described in the context of a digital camera, various 
modifications to the preferred embodiment will be readily 
apparent to those skilled in the art and the generic principles 
herein may be applied to other embodiments. That is, any 
image capture device which displays or prints images, icons 
and/or other items, could incorporate the features described 
hereinbelow and that device would be within the spirit and 
scope of the present invention. Thus, the present invention 
is not intended to be limited to the embodiment shown but 
is to be accorded the widest scope consistent with the 
principles and features described herein. 

The present invention provides an inexpensive method 
and system for capturing images and generating a formatted 
electronic document which includes or references those 
images. The document is readily interchangeable among 
users using a variety of computer implemented methods, 
such as, for example, email, LAN/WAN, or the Internet. The 
present invention also provides a process of creating the 
formatted document including the image which is intuitive 
and user friendly. In addition, the present invention includes 
a method and system for inexpensively making the format- 
ted document available via the Internet to web browser 
equipped users. The present invention and its advantages are 
further described below. 

Referring now to FIG. 1, a block diagram of a digital 
camera 110 is shown for use in accordance with the present 
invention. Camera 110 preferably comprises an imaging 
device 114, a system bus 116 and a computer 118. Imaging 
device 114 is optically coupled to an object 112 and elec- 
trically coupled via system bus 116 to computer 118. Once 
a photographer has focused imaging device 114 on object 
112 and, using a capture button or some other means, 
instructed camera 110 to capture an image of object 112, 
computer 118 commands imaging device 114 via system bus 
116 to capture raw image data representing object 112. The 
captured raw image data is transferred over system bus 116 
to computer 118 which performs various image processing 
functions on the image data before storing it in its internal 
memory. System bus 116 also passes various status and 
control signals between imaging device 114 and computer 
118. 

Referring now to FIG. 2, a block diagram of one preferred 
embodiment of imaging device 114 is shown. Imaging 
device 114 typically comprises a lens 220 having an iris, a 
filter 222, an image sensor 224, a timing generator 226, an 
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analog signal processor (ASP) 228, an analog-to-digital a camera 110 user may also connect power supply 356 to an 

(A/D) converter 230, an interface 232, and one or more external power source. During normal operation of power 

motors 234. supply 356, the main batteries 358 provide operating power 

In operation, imaging device 114 captures an image of to power supply 356 which then provides the operating 

object 112 via reflected light impacting image sensor 224 5 power to camera 110 via both main power bus 362 and 

along optical path 236. Image sensor 224, which is typically secondary power bus 364. During a power failure mode in 

a charged coupled device (CCD), responsively generates a which lhc main batteries 358 have failed (when their output 

set of raw image data in CCD format representing the voltage has fallen below a minimum operational voltage 

captured image 112. The raw image data is then routed level ) the backup batteries 360 provide operating power to 

through ASP 228, A/D converter 230 and interface 232. ™ power supply 356 which then provides the operating power 

Interface 232 has outputs for controlling ASP 228, motors onlv to the secondary power bus 364 of camera 110. 

234 and timing generator 226. From interface 232, the raw Referring now to FIG. 4, a memory diagram showing one 

image data passes over system bus 116 to computer 118. embodiment of dynamic random -access-memory (DRAM) 

Referring now to FIG. 3, a block diagram of one preferred 346 is shown. In the preferred embodiment, DRAM 346 

embodiment for computer 118 is shown. System bus 116 15 includes RAM disk 532, a system area 534, and working 

provides connection paths between imaging device 114, an memory 530. 

optional power manager 342, central processing unit (CPU) RAM disk 532 is a memory area used for storing raw and 

344, dynamic random-access memory (DRAM) 346, input/ compressed image data and typically is organized in a 

output interface (I/O) 348, non-volatile memory 350, and "sectored" format similar to that of conventional hard disk 

buffers/connector 352. Removable memory 354 connects to 20 drives. In the preferred embodiment, RAM disk 532 uses a 

system bus 116 via buffers/connector 352. Alternately, cam- well-known and standardized file system to permit external 

era 110 may be implemented without removable memory host computer systems, via I/O 348, to readily recognize and 

354 or buffers/connector 352. access the data stored on RAM disk 532. System area 534 

Power manager 342 communicates via line 366 with typically stores data regarding system errors (for example, 

power supply 356 and coordinates power management 25 why a system shutdown occurred) for use by CPU 344 upon 

operations for camera 110. CPU 344 typically includes a a restart of computer 118. 

conventional processor device for controlling the operation Working memory 530 includes various stacks, data struc- 

of camera 110. In the preferred embodiment, CPU 344 is tures and variables used by CPU 344 while executing the 

capable of concurrently running multiple software routines software routines used within computer 118. Working 

to control the various processes of camera 110 within a memory 530 also includes several input buffers 538 for 

multithreaded environment. DRAM 346 is a contiguous temporarily storing sets of raw image data received from 

block of dynamic memory which may be selectively alio- imaging device 114, and a frame buffer 536 for storing data 

cated to various storage functions. LCD controller 390 for display on the LCD screen 402. In a preferred 

accesses DRAM 346 and transfers processed image data to 35 embodiment, each input buffer 538 and the frame buffer 536 

LCD screen 402 for display. are split into two separate buffers (shown by the dashed 

I/O 348 is an interface device allowing communications lines) to improve the display speed of the digital camera and 

to and from computer. For example, I/O 348 permits an to prevent the tearing of the image in the display 402. 

external host computer (not shown) to connect to and FIGS. 5A and 5B are diagrams depicting the preferred 

communicate with computer 118. I/O 348 also interfaces ^ hardware components of the camera's 110 user interface 

with a plurality of buttons and/or dials 404, and an optional 408. FIG. 5A is back view of the camera 110 showing the 

status LCD 406, which in addition to the LCD screen 402, LCD screen 402, a four-way navigation control button 409, 

are the hardware elements of the camera's user interface an overlay button 412, a menu button 414, and a set of 

408. programmable soft keys 416. FIG. 5B is a top view of the 

Non-volatile memory 350, which may typically comprise 45 camera 110 showing a shutter button 418, and a mode dial 

a conventional read-only memory or flash memory, stores a 420. The camera may optionally include status LCD 406, 

set of computer-readable program instructions to control the status LCD scroll and select buttons 422 and 424, a sound 

operation of camera 110. Removable memory 354 serves as record button 426, and zoom -in, zoom-out buttons 426a and 

an additional image data storage area and is preferably a 426b. 

non-volatile device, readily removable and replaceable by a 50 The digital camera of the present invention is controlled 

camera 110 user via buffers/connector 352. Thus, a user who by graphical-user-interface (GUI) based operating system 

possesses several removable memories 354 may replace a (OS), which is in contrast to conventional digital cameras 

full removable memory 354 with an empty removable that are controlled by proprietary hardware architectures. In 

memory 354 to effectively expand the picture-taking capac- the preferred embodiment of the present invention, the OS 

ity of camera 110. In the preferred embodiment of the 55 provides the digital camera with several different operating 

present invention, removable memory 354 is typically modes for supporting various camera functions. Although 

implemented using a flash disk. Power supply 356 supplies the digital camera may include several different operating 

operating power to the various components of camera 110. modes, the modes relevant to this description are capture 

In the preferred embodiment, power supply 356 provides mode, and play mode. 

operating power to a main power bus 362 and also to a 60 In capture mode, the camera 110 supports the actions of 

secondary power bus 364. The main power bus 362 provides preparing to capture an image, and capturing an image 

power to imaging device 114, I/O 348, non-volatile memory through the use of either the LCD screen 402 alone or the 

350 and removable memory 354. The secondary power bus status LCD 406 with the aid of an optional optical view- 

364 provides power to power manager 342, CPU 344 and finder (not shown). In review mode, the camera 110 supports 

DRAM 346. 65 lne ac ti 0 ns of reviewing camera contents, editing and sorting 

Power supply 356 is connected to main batteries 358 and images, and printing and transferring images. In play mode, 

also to backup batteries 360. In the preferred embodiment, the camera 110 allows the user to view screen-sized images 
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in the LCD screen 402 in the orientation that the image was file. As the images are captured and text information entered, 

captured. Play mode also allows the user to hear recorded the images and text are tagged with HTML commands in 

sound associated to a displayed image, and to play back accordance with the model 

sequential groupings of images, which maycomprise time , n cxcmting a ^ , in accordaDCe ^ ^ p rese nt 

lapse, slide show and burst image images. The user prefer- 5 mvemi camm uo (es HJML fi[e indudm fc 

ably switches between the capture, review, and play modes, n . . , . 4 , „ C1 . r „j. 

using the mode dial 420. When the camera is placid into a l wherein ,** H F? L ? le » f 0 ??***™ 

particular mode, that mode's default screen appears in the accordance with the script s predefined model. The model 

LCD screen 402 in which a set of mode-specific items, such defines the formalt >ng and positioning information which 

as images, icons, and text, are displayed. determine the overall appearance of the web page. For 

The present invention provides an inexpensive method 10 * xamp !f'. a direcled ^ ca P t , u ™ 35 J* 

and system for capturing images and generating a formatted directed P** 9 ca P' ure ^ uence , ste P s ,he « hrou * h • 

electronic document which included those miages. TUe *r.es ofimage captures, me scnpt automat.caUy formats the 

document is readily interchangeable among users using a descn P Uve ufo ™ at,on ° r entered b X «» «*/ "J 

variety of computer implemented methodi, such as, for 1S acc ° rdance ™' h the model » 11141 ,he y a Pf ear "1 a des " r ( f d 

example, email, LAN/WAN, or the Internet. The present " manne f m respe u cl '° ^ corresponding picture (for 

• , or ^- ^ t „vw , rtf ,u f L 4t j example, specifying that the title of the image be centered 

invention provides a process or creating the formatted , » • , , f 

a # • I j* • I.* u ■ ■ *. j above the picture and in a relatively large font, while the 

document including the image which is intuitive and user . v .„ , t / B . ' „ ~T , 

friendly. The document can be created in any of a number of ^ 0tall0ns are M ow the picture m . smaller font), 

formats. Such formats include, for example, HTML format, 2n ^ ° DCe th * ^ has P ro S ressed *™gb and completed a 

Postscript format, Acrobat format, and the like. 2 ° S iven <h f? cd m *& ca P ture ^ uc 2 c S^ mc ™ U0 has 

» . i . generated the corresponding formatted HTML file. 

In one embodiment, the present invention comprises a 
method and system wherein camera 110 automatically gen- . In the embodiment where the script does not include a 
erates a formatted HTML file referencing images captured directed image capture sequence, the script functions in a 
by the user. This is accomplished through the use of a script. 25 substantially similar manner, except that the user is not 
As used herein, a script is an interpreted program written Prompted to take pictures. Rather, the user could be 
with text-based commands. A script may also be written Prompted to select pictures from a set stored in the memory 
using other interpreted languages, such as BASIC and LISP, of me camera ' stored on removable media, or stored else- 
for example. A script in accordance with the present inven- where " M me P artlcular pictures are selected, the script 
tion also includes a predefined set of commands which 30 prompts and directs the user for any descriptive information, 
determine the formatted appearance of a web page. The annotations, and the like, in the same manner as the script 
script is interpreted by camera 110, which performs the ^eluding the directed image capture sequence, 
actions, steps, functions, and the like, as dictated by the In both embodiments, camera 110 allows a user to pro- 
script. The predefined set of commands which determine the duce a completed, formatted, HTML file (e.g., one or more 
formatted appearance of a web page are referred to as a 35 weD pages) which references the resulting images from the 
model. The model is designed (e.g., by the user, a third party digital camera, without requiring the user to have any 
developer, or the like) to give the resulting web page its knowledge of HTML or HTML formatting. In addition, the 
distinctive appearance. present invention allows the user to annotate and enter 

For example, in one embodiment, a script can be created descriptive information regarding the images at the time 

that sequentially directs the user to select from a set of 40 thev are captured, rather than having to first transfer the 

previously captured images stored within camera 110, enter captured images to a PC or enter notes elsewhere, 

annotations regarding each image, and automatically format Although the embodiment of the present invention 

an HTML file in accordance with a predefined model. described herein and below generates a formatted HTML 

Alternatively, in another embodiment, a script can be created file, it should be appreciated that the images and information 

that directs the user to take a series of images, enter 45 entered by the user can be formatted in accordance with 

annotations for the images, and automatically format an other well known graphics, document, or interchange for- 

HTML file in accordance with the predefined model. In both matting standards (e.g., Postscript, Acrobat, etc.). Generat- 

cases, the HTML commands which determine the ing formatted HTML files provides the advantage of rela- 

appearance, hereafter referred to as the format, of the tively widespread interchangability due to the ubiquity of 

resulting web page are generated by the script in accordance 50 web browsers and the World Wide Web. In addition, it 

with the predefined model. should be appreciated that a script in accordance with the 

In the embodiment where the script includes a directed present invention is not required to include a directed image 

image capture sequence, the directed image capture capture sequence, although the scripts of the embodiments 

sequence provides a series of instructions which prompts described below include directed image capture sequences, 

and directs the user through a sequence actions, such as, for 55 Th e scripts of the present invention and their operation are 

example, taking a picture, promoting the user for any further described below. 

descriptive information regarding the picture, prompting the Referring now to FIGS. 6 A and 6B, diagrams illustrating 

user for annotations, and the like. Camera 110 executes the example directed image capture screens are shown. FIGS, 

directed image capture sequence, and typically displays 6 A and 6B show LCD screen 402, four way navigation 

interactive instructions on LCD screen 402 that guide the 60 control button 409, overlay button 413 and menu button 415. 

user through the scripted sequence. Camera 110 keeps track User interaction with the GUI based operating system of 

of the user's progress through the scripted sequence and camera 110 is via implemented, in part, through the use of 

automatically updates the interactive instructions, such that dynamic overlay bars 430 and 432. Overlay bars 430 and 

the user is guided through a series of related image captures 432 are used to provide the user with various status infor- 

to obtain a series of resulting images. The model functions 65 mation of the camera and provide various instructions for 

as a "blue print" which describes the appearance and logical using the camera, including interactive instructions associ- 

structure of the resulting web page described by the HTML ated with a script, or more particularly, a script including a 
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directed image capture sequence. The information or 234 (FIG. 2) and a flash (not shown). Kernel 614 comprises 

instructions displayed by overlay bars 430 and 432 is program instructions providing basic underlying camera 

typically specific to the particular operating mode of camera operating system services including synchronization 

110. Overlay bars 430 and 432 are located on LCD 402 so routines, task creation, activation and deactivation routines, 

as not to obscure any image or object currently being 5 resource management routines, etc. Startup/configuration 

viewed. In accordance with the present invention, overlay ^ comprises program instructions for providing initial 

bars 430 and 432 provide interactive instructions which camera 110 start-up routines such as the system boot routine 

guide the user through the directed image capture sequence and tem diagD0S ti cs 

and any other actions of the script. „„■ + + * > n 

n , , CK . • . When the camera 110 is first turned on and booted up, the 

For example, the screen shown m FIG. 6 A may pertain to 1rt - > , . i < - , 

an insurance-related directed image capture that prompts an 10 startup/configuration 616 module begins to execute and 

insurance claims adjuster to take a series of pictures of a £ads the drivers 612, the kernel 614, the control application 

damaged vehicle, or it may pertain to a real estate applica- 6Q2 > and svstem files containmg configuration information 

tion that guides a user through taking photos of a house for mt0 DRAM 346. Thereafter, operation of the camera is 

sa l e passed to the control application 602. In an alternative 

In the insurance example, once the directed image capture 15 embodiment, the software 600 may executed out of ROM 

has started, the user may be instructed to take various views 350 m order to reduce the size of DRAM 346. 

of the damaged car. The user may also be shown the number The script for directed image capture sequence 618 may 

of the current image in that sequence, and the total number be loaded into the digital camera 110 from the removable 

of images to be captured. memory 354 (FIG. 3), a host computer, or a network, and 

After the pictures of the car are taken, the script may then 20 stored in DRAM 346 to run in place of the control appli- 

prompt the user to enter specific information, such as the cation 602. Once loaded into the camera, the script may be 

name of the image, as shown in FIG. 6B. The user may then selected by the user from a menu where it is displayed for 

enter text by choosing letters using the four- way control selection, and is thereafter executed by the control applica- 

button 409. For insurance purposes, the script may also tion 602 by passing the script to the script interpreter 610. 

request the user to input the owner's name, license plate 25 The script interpreter 610 then translates and executes the 

number, claim number, and so on. script instructions comprising the directed image capture 

A formatted HTML file is then generated using the sequence 618 one-by-one. 

captured images and the entered information. The format- As the user sequences through the script, the HTML code 

ting is in accordance with the script's predefined model. The 3Q for the resulting file is generated. For example, as the user 

HTML file may then be downloaded from the camera (e.g., is prompted to take specific pictures, such as the various 

via removable storage media, via universal serial bus, or views of the car as described in the insurance example 

some other means), for example, to a PC for storage in a above, the user may also be prompted to enter descriptive 

database, or to a web server for display as a web page. information regarding each picture. The script records this 

In one embodiment of the present invention, one or more 35 information and the corresponding images along with the 

scripts (e.g., for different directed image capture sequences) HTML commands in a file. As described above, the HTML 

may be provided in the camera as built-in functions, espe- commands are generated in accordance with the script's 

cially if the camera is tailored for specific industries (e.g., predefined model. These commands determine the 

the insurance industry). appearance, or the format, of the web page described by the 

However, the camera may be made more flexible by 40 resulting file, and hence, the file is typically referred to as an 

implementing the scripts as a set of program instructions that HTML file. In one embodiment, the information, HTML 

are externally loaded into the camera. Once loaded in the commands, and references to the pictures are stored in the 

camera 110, the instructions comprising the scripts are then file incrementally, as the user sequences through the script, 

preferably executed by the GUI-based system software Alternatively, the user supplied information and references 

running on CPU 344. 45 to the pictures can be stored in the file, and then the 

FIG. 7 is a block diagram illustrating the contents of ROM appropriate HTML commands inserted at the conclusion of 

350 where the software is stored, and DRAM 346 where the the of the script. The pictures themselves are typically stored 

software is executed. The software 600 may include a as separate associated files which are referenced by the 

control application 602, a toolbox 604, drivers 612, a kernel HTML file. In either case, once the file is completed, the web 

614, and a startup/configuration module 616. The control 50 P a S e ^ read y t0 be viewed using a web browser, 

application 602 is the main program that controls high-level As is well known, the HTML file is interpreted by a web 

functions of the digital camera and is responsible for inter- browser, which in turn, displays a resulting web page. The 

facing with functions in the toolbox 604. commands included in the HTML file describe the logical 

Toolbox 604 comprises selected function modules that structure of the web page. The HTML file includes ASCII 

control how the digital camera captures and manipulates 55 text with embedded HTML tags which instruct the web 

images. The modules may include image processors 606, a browser as to the appropriate font, position, etc., for the text, 

camera control shell 608, and a script interpreter 610. Image The images are also associated with HTML tags describing 

processors 606 are programs for enhancing (e.g., adjusting their attributes with respect to the web page (e.g., position, 

the contrast, sharpening, converting the image to gray-scale, relative size, etc.). The web browser interprets the HTML 

etc.) the digital image received from imaging device 114. 60 file aad displays the web page, or pages, described by the 

Camera control shell 608 receives and processes data struc- file. Thus, the process of generating an HTML file is often 

hires for controlling camera functions. Script interpreter 610 referred to as generating a web page and the process of a web 

translates and executes script statements, which are used to browser accessing and interpreting the HTML file is often 

provide the directed image capture sequences and other referred to as displaying a web page, 

camera 110 features, as explained below. 65 fig. 8 is a flow chart illustrating an exemplary process of 

Drivers 612 comprise program instructions for controlling installing and running a script in accordance with one 

various camera 110 hardware components, such as motor embodiment of the present invention. In this embodiment, 



09/30/2003, EAST Version: 1.04.0000 



US 6,223,190 Bl 

11 12 

the script includes a directed image capture sequence. The mand causes control of the camera 110 to pass back to the 

process begins by inserting the removable memory 354 in control application 602 until the user presses the shutter 

step 700. When the removable memory 354 is installed, the button 418 to capture an image. The "WaitForShutter" 

removable memory 354 is mounted by the operating system command is preferably called with a quoted string parameter 

600 m step 702. Thereafter, the operating system searches 5 ^ fe ^ in lhe d ic QVerl bar 43Q ^ lhe tQ 

for system files on the removable memory 354, which alert . . j w ~ . , ■ - 

»i a- *« i — nn « r * _ i the user requestmg an image capture (e.g.. Take photo of 

the digital camera 110 to the presence of an external , . J* , & „ , & , v „ , v f „ r x 

program in step 704 kitchen , Take photo of the front of the house , etc.). 

Any system files found on the removable memory 354 [f the command is a "WaitForShutter" command in step 
and corresponding directed image capture sequences 618 1Q 714j lhen control is returned to the script after the user 
and associated models are then installed and made available ^ the shutter bulton 418 ^ st n6 tQ ^ M 
to the user for selection via menu choices that appear on the ^ , f fetched mmnand fa "WaitForShutter" 
LCD screen 402 in step 706. • . - . - 
~ i i . * :. , . . ... , At _ command in step 714, then the script interpreter 610 inter- 
Once the list of available scripts are displayed, the user , - - . 
selects one of them (e.g., the Script for directed image P rcts and execmes lhe commaiid m step 718. 
capture sequences 618) to run in step 708. In a preferred i n step 719^ depending upon the command interpreted in 
embodiment, the list showing the available scripts may be st 714 and 718 ^ ^ t geQerates ^de in accordance 
categorized in menus for easier ; selection. For example, with the script's predefined model. For example, if a picture 
assume a real estate agent has three dure rent scripts for . . . . . , . ' , 
capturing images of different types of properties. The agent ^^ATll 1 u \ * ta&ged 
may name or create categories for the directed image capture 20 with formatting HTML codes which describe its location on 
sequences called "commercial", "industrial", and tne web P a S e * If information is entered by the user, the 
"residential", for instance. Selecting the residential category, information (e.g., ASCII text) is similarly tagged with for- 
for example, will cause a list of directed image captures to matting HTML codes. Thus, one or more formatted HTML 
be displayed that are designed to capture pictures of different files are generated as the user progresses through the script, 
types of residential properties, such as one, two, and three 25 ^ 

bedroom homes. The user may then select a desired script ^ ^"P 1 continues to execute, with new commands 

depending on the particular house to be shot. bem 8 fetched from memory, until the end of the script is 

After the user selects a particular script to run (e.g., the re t ac u hed ' 35 s u bowD b y If il » determined if the end 

script including directed image capture sequence 618), the of the scnpt has been reach^m step 720, control is returned 

script interpreter 610 begins interpreting the directed image 30 !°J he ~" Uo1 application 602. If not, then the next command 

capture sequence 618 in step 710, and control is passed from « Niched in step 712 and the process continues until the end 

the control application 602 to the script. In step 712, the of the scnpt is reac^ Onc« me end of the script is reached, 

script interpreter 610 fetches the first command comprising me on , e or u more H™*- ^ are closed and sa ™ d ° nce 

the directed image capture sequence 618. The script also CODtto \ re l , | rned ' me one ,°f , more «™pleted, for- 

opens a new HTML file, in which the user entered 35 matte , d J? TML files are available to the user for 

information, HTMLcommands, and the like are to be stored. downloading, storage, or any other use. 

It is then determined whether the fetched command is a An exemplary portion of a script in accordance with one 

script "WaitForShutter" command in step 714. This com- embodiment of the present invention is shown below: 



# Open HTML file and write header info to it. 
Display Line ("Writing header info") 
FileOpen (2, "HOME3.HTM", 1, fileld) 
WriteLine (fileld, "<html>") 
WriteLine (fileld, 
WriteLine (fileld, "<head>") 

WriteLine (fileld, " <!- To change the window title, replace the words 
Christopher Realty, Inc.\" ->") 

WriteLine (fileld, " <!- below with whatever words you want to appear — >") 
WriteLine (fileld, "titloChristopher Realty, Inc. </title>") 
WriteLine (fileld, "</head>") 
WriteLine (fileld, "") 

WriteLine (fileld, "<BODY BGCOLOR- r#FFFFCCT>") 
WriteLine (fileld, "<P><IMG SRC-\"logo.gifV' WIDTH- \"468\" 
HEIGHT- \"53Y* ALIGN- \ "BOTTOM\ " BORDER- \ "0\"<>/P>") 
#Chcose property and set values accordingly 
DisplayClear Q 

Display Line ("Select the property that you wish to create a web page for") 
Wait (2000) 

SetOption (1, "401 Cristobal Street", 0) 
SetOption (2, "958 Willowleaf Drive", 0) 
SetOption (3, "2702 WindHuff Lane", 0) 
GetOption (choice) 
if choice — 1 

WriteLine (fileld, "<P><BR><BR><FONT SIZE- r5\"><B>401 Cristobal 
Street</B></FONT><BR>") 

WriteLine (fileld, "<TABLE BORDER-0 cellpadding-0>") 
WriteLine (fileld, "<TR>") 
footage - 2300 
acreage - "1" 
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age - 12 

end 

if choice « 2 

Write Line (fileld, "<PxBR><BR><FONT SIZE- \"5\"><B>958 Willowieaf 
Drive </B></FONTxBR>") 

Wrileline (fUeld, "<TABLE BORDER-0 cellpadding=0>") 
Wrileline (fueld, "<TR>") 
footage - 3500 
acreage = "V* 
age - 5 

end 



Referring now to FIG. 9, a web page described by an 
HTML file created by a script of the present invention is 
shown. This script is for use in the real-estate industry, as its 
model is designed to format a web page suited for adver- 
tisement. As shown in FIG. 9, three images are included in 
the HTML file, along with descriptive information. As 
described above, the images are located and scaled with 
respect to the web page in accordance with the script's 
predefined model. The model also automatically inserts the 
text entered by the user into the desired location and 
automatically applies formatting, such as font type and size, 
justification, etc. For example, the script may prompt the 
user for the address of the house, "958 Willowieaf Drive", 
and store the entered information in the resulting HTML file 
with its defined formatting. Thus, the user is able to create 
the web page as shown in FIG. 9 without having to learn or 
memorize any HTML formatting commands, features, etc. 

In another embodiment of camera 110, camera 110 
includes the necessary software and the necessary compu- 
tational resources (e.g., computer 118) to act as a web server 
and host the web page defined by the HTML file itself, 
eliminating the requirement for the expensive personal com- 
puter. In so doing, camera 110 can make the HTML files 
created in accordance with the present invention directly 
available over the Internet, as opposed to downloading the 
HTML files to a separate computer system for display by 
that system's web server. 

Referring now to FIG. 10, a diagram 800 of camera 110 
coupled to Internet 750 is shown. Diagram 800 shows 
camera 110 coupled to an external modem 801. Camera 110 
is coupled to modem 801 via any of several communications 
means (e.g., USB, IEEE1394, infrared link, etc.). Modem 
801 is in turn coupled to a telephone jack 802 at the camera's 
location. The telephone jack 802 couples modem 801 to one 
of the modems 803 of an ISP (Internet service provider) 710 
via the telephone company's local loop. An ISP 760 is 
directly coupled to the Internet 750 via a Tl line. 

Modem 801 is shown as an external modem. However, 
the functionality of modem 810 can be implemented directly 
within the electronics of camera 110 (e.g., via a modem 
ASIC), or alternatively, can be implemented as a software 
only modem executing on computer 118 within camera 110. 
As such, it should be appreciated that, at the hardware 
connectivity level, modem 801 can take several forms. For 
example, a wireless modem can be used in which case the 
camera is not connected via an external wire to any land line. 
Alternatively, there may even be applications in which 
camera 110 includes suitable electronic components 
enabling a connection to a conventional computer system 
network (e.g., ethernet, Apple talk, etc.), which is in turn, 
directly connected to the Internet (e.g., via a gateway, a 
firewall, etc.), thereby doing away with the requirement for 
an ISR Hence, it should be appreciated that the present 



is invention is not limited to any particular method of access- 
ing the Internet 750. 

Referring now to FIG. 11, a diagram 900 of the connec- 
tivity and application software of camera 110 is shown. At 
the software level, computer 118 of camera 110 hosts a 

20 TCP-IP protocol stack (including PPP (Point to Point 
Protocol)), which, as is well-known in the art, enables 
communication via the Internet. Protocol stack 901 inter- 
faces with the physical connection hardware 902 of camera 
110 and the application layer 903. The bottom of protocol 
stack 901 includes communication hardware interface driv- 

25 ers which interfaces directly with the various communica- 
tions hardware camera 110 must function with (e.g., USB, 
IEEE1394, etc.). The top of protocol stack 901 includes 
software APIs and protocol libraries which interface with 
web server application 910 running in an applications layer 

30 903. Applications layer 903 interfaces with an operating 
system 904. Applications layer 903, protocol stack 901, and 
operating system 904 are instantiated as software modules in 
DRAM 346 of camera 110. 
The web server application 910 runs within applications 

35 layer 903, along with other software applications which 
provide camera 110's functionality (e.g., still image 
downloading, motion detection, aim control for a remote 
aiming device, and the like). The web server application 910 
responds to queries from the user's Internet web browser 

40 and other web browsers, which include user requests 
directed to the camera (e.g., requests for various web pages 
hosted by camera 110) and communicates with other soft- 
ware applications within applications layer 903. These 
applications each communicate with operating system 904 

45 of the camera 110, which controls the hardware functionality 
of camera 110 (e.g., taking pictures, storing pictures, and the 
like). HTTP requests are received and HTML files are 
transferred to and from the web server application 910 via 
protocol stack 901, and communications hardware 902. 

50 Additional details regarding the hosting and display of 
web pages within a digital camera, and remote access there 
to, may be found in U.S. patent application Ser. No. 09/044, 
644, entitled "A method and system for hosting an Internet 
web site on a digital camera", which is incorporated herein 

55 by reference. 

Thus, the present invention provides an inexpensive 
method and system for capturing images and generating a 
formatted electronic document which includes those images. 
The document is readily interchangeable among users using 

60 a variety of computer implemented methods, such as, for 
example, email, LAN/WANs, or the Internet. The present 
invention also provides a process of creating the formatted 
document including the image which is intuitive and user 
friendly. In addition, the present invention includes a method 

65 and system for inexpensively making the formatted docu- 
ment available via the Internet to web browser equipped 
users. 
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The foregoing descriptions of specific embodiments of the 
present invention have been presented for purposes of 
illustration and description. They are not intended to be 
exhaustive or to limit the invention to the precise forms 
disclosed, and obviously many modifications and variations 5 
are possible in light of the above teaching. The embodiments 
were chosen and described in order to best explain the 
principles of the invention and its practical application, to 
thereby enable others skilled in the art to best utilize the 
invention and various embodiments with various modifica- 
tions as are suited to the particular use contemplated. Il is 
intended that the scope of the invention be defined by the 
claims appended hereto and their equivalents. 

What is claimed is: 

1. A method for generating an Internet page description 
file on a hand-held digital camera that references images 15 
captured by the hand-held digital camera, wherein the hand- 
held digital camera includes a display, the method compris- 
ing the steps of: 

a) displaying interactive instructions on the display that 
prompt a user to perform 20 

b) in response to the user performing the specific 
operations, automatically updating the interactive 
instructions, such that the user is guided through a 
series of related image captures to obtain a series of 
resulting images; and 25 

c) generating an HTML (hypertext markup language) file 
referencing the resulting images, wherein the HTML 
file is formatted in accordance with a predefined model, 
such that a formatted HTML file is automatically 
generated by the hand-held digital camera. 30 

2. The method of claim 1 wherein step b) further includes 
the step of providing the interactive instructions by exter- 
nally loading a script into the hand- held digital camera. 

3. The method of claim 1 wherein step b) further includes 
the step of providing the script as a text-based script. 35 

4. The method of claim 1 wherein step c) further includes 
the step of executing the script by the hand-held digital 
camera interpreting the text-based script. 

5. The method of claim 1 wherein step d) further includes 
the step of prompting the user for specific information, and 40 
entering the specific information on a text entry screen. 

6. The method of claim 1 further including the step of 
displaying the interactive instructions on a translucent over- 
lay bar. 

7. The method of claim 1 further including the steps of: 45 

d) coupling the band-held digital camera to the Internet; 
and 

e) making the HTML file available via the Internet by 
hosting a web server application on the hand-held 5Q 
digital camera. 

8. A method for generating an Internet page description 
file on a hand-held digital camera that includes a display, the 
method comprising the steps of: 

a) allowing a user to load a script onto the hand-held 55 
digital camera, the script comprising a set of program 
instructions; 

b) executing the script to display interactive instructions 
on the display that prompt a user to perform specific 
operations; 60 

c) in response to the user performing the specific 
operations, automatically updating the interactive 
instructions, such that the user is guided through a 
series of related image captures to obtain a series of 
resulting images; 65 

d) generating an internet page description file referencing 
the resulting images, wherein the internet page descrip- 
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tion file is formatted in accordance with a predefined 
model included in the script, such that a formatted 
internet page description file is automatically generated 
by the digital imaging device; 

e) allowing the user to couple the hand-held digital 
camera to the Internet; and 

f) making the internet page description file available via 
the Internet by hosting a web server application on a 
computer system within the hand-held digital camera. 

9. The method of claim 8 wherein step a) further includes 
the step of providing the script as a text-based script. 

10. The method of claim 9 wherein step b) further 
includes the step of executing the script by the computer 
system interpreting the text-based script. 

11. The method of claim 10 wherein step c) further 
includes the step of prompting the user for specific 
information, and entering the specific information on a text 
entry screen. 

12. The method of claim 11 wherein the internet page 
description file is a hypertext markup language file. 

13. In a hand-held digital imaging device including a 
display, a system for generating a formatted document 
including text and images, comprising: 

a set of program instructions which, when executed, cause 
the hand-held digital imaging device to perform the 
steps of: 

a) displaying interactive instructions on the display that 
prompt a user to perform specific operations; 

b) in response to the user performing the specific 
operations, automatically updating the interactive 
instructions, such that the user is guided through a 
sequence of the interactive instructions adapted to 
capture information from the user; 

d) transferring the information captured from the user to 
a formatted document, wherein the formatted document 
is formatted in accordance with a predefined model, 
such that the formatted document is automatically 
generated by the hand-held digital imaging device. 

14. The system of claim 13 wherein step a) further 
includes providing a sequence of interactive instructions for 
a directed image capture, wherein the program instructions 
prompt the user through a series of related image captures, 
resulting in a plurality of stored images. 

15. The system of claim 13 wherein step a) further 
includes the step of providing the program instructions as a 
text-based script, and wherein the hand -held digital imaging 
device guides the user through the sequence of interactive 
instructions by a computer system interpreting the text- 
based script. 

16. The system of claim 13, wherein the predefined model 
comprises the set of programming instructions which deter- 
mine the formatted appearance of the document. 

17. The system of claim 16, wherein the predefined model 
is predefined in accordance with a particular purpose of the 
script such that the formatted document has an appearance 
in accordance with the particular purpose. 

18. The system of claim 13, wherein the document is an 
internet page description file which defines a web page. 

19. The system of claim 18, wherein the hand-held digital 
imaging device is coupled to the Internet and the internet 
page description file is made available by a web server 
application executing on a computer system of the hand-held 
digital imaging device. 

***** 
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